A Randomized Trial of the Effects of Schema-Based Instruction on Proportional Problem- 


Solving for Students with Mathematics Problem-Solving Difficulties 

This is a pre-copyedited, author-produced PDF of an article that has been published in the 
Journal of Learning Disabilities following peer review. The version of record [citation 
information below] is available online at http://dx.doi.org/10-l 177/0022219416629646 

Jitendra, A. K., Harwell, M. R., Dupuis, D. N., & Karl, S. R. (2015). A randomized trial of the 
effects of schema-based instruction on proportional problem solving for students with 
mathematics problem-solving difficulties. Journal of Learning Disabilities. Advanced online 
publication doi: 10.1177/0022219416629646 

Asha K. Jitendra 

University of Minnesota 

Michael R. Harwell 

University of Minnesota 

Danielle N. Dupuis 

University of Minnesota 

Stacy R. Karl 

University of Minnesota 


Author’s Note 

The research reported here was supported by grant R305A1 10358 from the Institute of Education 
Sciences, U.S. Department of Education. The ideas, findings, and conclusions or 
recommendations in this paper are those of the authors and do not represent the official views of 
the Institute of Education Sciences or the U.S. Department of Education. We wish to 
acknowledge Susan Slater, the project coordinator, and research assistants Amy Lein and 
Gregory Simonson, for their contributions to data collection as well as thank the seventh-grade 
math teachers and students throughout Minnesota who participated in the study. 



THE EFFECTS OF SCHEMA-BASED INSTRUCTION 


2 


Abstract 

This paper reports results from a study investigating the efficacy of a proportional problem- 
solving intervention, schema-based instruction (SBI), in seventh grade. Participants included 806 
students with mathematical difficulties in problem solving (MD-PS) from an initial pool of 1,999 
seventh grade students in a larger study. Teachers and their students in the larger study were 
randomly assigned to a SBI or control condition and teachers in both conditions then provided 
instruction on the topics of ratio, proportion, and percent. We found that students with MD-PS in 
SBI classrooms scored on average higher than their counterparts in control classrooms on a 
posttest and delayed-posttest administered nine weeks later. Given students’ difficulties with 
proportional problem solving and the consequences of these difficulties, an important 
contribution of this research is the finding that when provided with appropriate instruction, 
students with MD-PS are capable of enhanced proportional problem solving performance. 

Keywords: Schema-based instruction, proportional reasoning, problem solving, mathematics 


difficulties 
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A Randomized Trial of the Effects of Schema-Based Instruction on 
Proportional Problem-Solving for Students with Mathematics Problem-Solving Difficulties 

Proportional reasoning, which requires understanding the multiplicative relations between 
quantities (ratios) as well as the “covariance of quantities and invariance of ratios” (Lamon, 
2007, p. 638), is important in understanding advanced mathematics topics and problems in 
science and technology (Beckmann & Izak, 2015; Fujimura, 2001; Lobato, Ellis, Charles, & 
Zbiek, 2010; National Mathematics Advisory Panel [NMAP], 2008). Despite its importance, 
learning and understanding ratios and proportional relationships has proven to be challenging for 
most learners (Adjiage & Pluvinage, 2007; Fujimura, 2001; Jitendra, Woodward, & Star, 2011; 
Lamon, 2007; Lobato, Ellis, Charles, & Zbiek, 2010; NMAP, 2008) and “transcends topical 
barriers in adult life” (Ahl, Moore, & Dixon, 1992, p. 81). The consequences of these difficulties 
are pronounced for students in an increasingly competitive job market, where the demand for 
mathematics-intensive science and engineering jobs are outpacing overall job growth three-to- 
one (NMAP, 2008). 

Instructional time focused on ratios and proportional relationships in the Common Core 
State Standards (CCSS; National Governors Association Center for Best Practices & Council of 
Chief State School Officers, 2010) occurs in middle school when students leam “to solve single 
and multi-step problems . . . solve a wide variety of percent problems, including those involving 
discounts, interest, taxes, tips, and percent increase or decrease” (p. 46). Solving even simple 
proportion problems is challenging for many children and adolescents, especially students with 
mathematics difficulties (MD). These students’ difficulty may be related to not only 
understanding the problem situation, but also whether a particular solution strategy is 
appropriate. For example, a problem might involve two situations that appear to have different 
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quantities (e.g., $3 for 6 apples, $6 for 12 apples) but the relations between the quantities 
remain constant (i.e., each apple costs $0.50). To solve this problem, students would need to 
recognize how relationships between quantities covary and identify relevant information to 
create an adequate representation of the problem (Lamon, 1999; Mayer, 1999), as well as 
demonstrate procedural flexibility to “choose strategically from among multiple solution 
methods based on their relative efficiency with respect to a given problem” (Berk, Taber, 
Gorowara, & Poetzl, 2009, p. 1 14). 

Although several problem-solving interventions have been developed to help students 
with MD be more effective problem solvers (e.g., Xin & Jitendra, 1999; Zhang & Xin, 2012), the 
majority of research has focused on arithmetic and arithmetic story problems. As such, there is a 
general need for interventions focusing on complex problems (e.g., ratios and proportions, 
percent). Instructional interventions intended to promote understanding of ratios and proportional 
relationships are most useful when they provide opportunities for recognizing the underlying 
problem structure, using representations (e.g., diagrams) that illustrate the mathematical relations 
among key elements in the problem, facilitating problem solving and metacognitive strategy 
skills, and developing procedural flexibility (see Woodward et al., 2012). 

An example of an instructional approach possessing these characteristics that was 
developed with the aim of improving student learning of ratios and proportional relationships is 
schema-based instruction (SBI). SBI is an instructional approach that has its roots in schema 
theory (Briars & Larkin, 1984; Carpenter, Hiebert, & Moser, 1981; Fennema, Carpenter, & 
Peterson, 1989; Riley, Greeno, & Heller, 1983) and incorporates cognitive models of 
mathematical problem solving (see Marshall, 1990; Mayer, 1999). In addition, SBI integrates 
several instructional features (e.g., explicit and systematic instruction, scaffolding instruction 
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with guided questions to help clarify and refine student thinking, corrective feedback, 
frequent and cumulative review of key concepts) that are considered conducive to promoting 
problem solving for students with MD (Gersten, Beckmann, et ah, 2009; Gersten, Chard, et al, 
2009). 

Since the initial studies of SBI that focused on teaching students to solve arithmetic 
problems (e.g., Jitendra et ah, 1998, 2013), SBI has been developed to embed its instructional 
components (e.g., priming the underlying problem structure) into the content instruction for ratio, 
proportion, and percent that is aligned with state standards. The findings of several randomized 
controlled studies provide evidence of the effectiveness of SBI for typically achieving middle 
school students (Jitendra et al., 2009, 2011, 2013; Jitendra, Harwell, et al., in press). However, 
only one randomized controlled study assessed the efficacy of SBI for students with MD on 
word problem solving involving multiplicative compare and equal groups problems (Xin, 
Jitendra, & Deatline-Buchman, 2005). Results indicated that students in the SBI group made 
significant gains at immediate posttest ( d = 1.69) and on retention tests (cl = 2.53) compared to 
students in the comparison condition when provided with about 720 min (12 sessions of 60 min) 
of remedial intervention. 

In a limited number of SBI studies conducted in middle schools, students met the 
criterion for mathematical difficulties (i.e., low average performance on a standardized math 
achievement test) and were categorized as having MD (Jitendra et al., 2009; Jitendra & Star, 
2012; Jitendra, Dupuis, Star, & Rodriguez, in press). These studies have yielded mixed results in 
that two studies suggested that the SBI intervention is not always promising for students with 
MD (Jitendra et al., 2009; Jitendra & Star, 2012); specifically, differences between SBI and 
business-as-usual control conditions on a ratio and proportion or a percent problem-solving test 
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were not significant. One explanation for the non-significant results may be due to the 
relatively short duration of the intervention, which was about 450-500 min (9-10 sessions of 50 
min). The authors argued that for these students to show gains in solving a wide range of 
problems, they may have needed more time and support to recognize the underlying problem 
structure, select and use the appropriate diagram to represent the problem, choose from among several 
methods, as well as monitor and reflect on the problem solving processes (essential features of SBI). 

The Jitendra, Dupuis, et al. (in press) study, with a longer time frame, provided evidence 
that it is possible to have positive effects on the proportional problem solving performance of 
students with mathematics difficulties only (MD, scored < 25 th percentile in mathematics and 
scored > 25 th percentile in the reading subtest on end-of-the-year state mathematics and reading 
achievement tests) and students with mathematics and reading difficulties (MDRD, scored < 25 th 
percentile in both mathematics and reading) when SBI instruction occurred over the course of 6 
weeks of daily 45 min sessions (about 1350 min in total). Due to the intensity of the support, 
students with MD and MDRD in the SBI condition not only outperformed their counterparts in 
the control condition on a proportional problem solving immediate posttest (g = 0.40), but also 
sustained the effects 6-weeks after the intervention (g = 0.42). However, SBI students’ 
responsiveness to treatment was differentiated by their performance on items related to only ratio 
and proportion versus percent. For students with MDRD, positive immediate and sustained 
effects were found on both ratio and proportion and percent problems. Similar positive 
immediate and sustained effects were found for students with MD on percent problem solving 
only. In sum, the evidence from the few investigations underscores the need for interventions 
that support students with MD become proficient in proportional problem solving. 
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The Present Study 

Building on prior studies, we evaluated the effectiveness of SBI on proportional reasoning 
skills for seventh-grade students with mathematical difficulties in problem solving (MD-PS). 
Specifically, we examined these students’ responsiveness to a 6-week treatment (SBI vs. control 
group) on the immediate and retention tests of proportional problem solving. The research 
questions this study addresses are whether SBI is effective in enhancing the proportional 
problem-solving skills of seventh graders’ with MD-PS (below the 35 th percentile) immediately 
after the treatment is completed and whether the effects of SBI are maintained 9 weeks after the 
treatment is completed. In addition, the study examined the effect of SBI on a student’s growth 
over time. Based on previous research described above, we examined the following hypotheses: 

1. SBI involves effective instructional practices (e.g., activating the mathematical 
structure of problems, representing the problem situation using an appropriate diagram, 
strategically selecting from among a variety of methods for a given problem that is 
efficient, monitoring and reflecting on the problem solving processes) that will have 
positive immediate and sustained effects on students’ proportional problem solving 
performance. More specifically, students with MD-PS receiving SBI will outperform 
students with MD-PS in a control condition on both immediate and retention tests of 
proportional problem solving. Furthermore, we expected that SBI would yield similar 
positive effects on both ratio and proportion, and percent problems. 

2. As SBI supports student learning of ratios and proportional relationships, it should have 
a pronounced positive effect on a student’s growth over time. 
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We also assessed whether students and their teachers who participated in the SBI 
intervention reported benefits of the SBI intervention (e.g., use of schematic diagrams, problem 
solving procedure) in solving proportion problems. 

Method 

Research Context and Design 

The sample in the current study was taken from a larger study (Jitendra, Harwell, et ah, in 
press) that included a heterogeneous pool of seventh-grade students. The target population was 
middle school students and teachers in the upper mid-west of the U.S. Eighty-two teachers from 
58 middle schools in 50 public school districts in Minnesota participated in the Jitendra, Harwell, 
et al. study (for information about demographics of the schools/school districts, see Jitendra, 
Harwell, et al.). Once a teacher had been selected, one of their seventh grade mathematics classes 
was selected at random to participate. Jitendra, Harwell, et al. used a randomized cluster design 
with longitudinal data (pretest, posttest, delayed posttest) in which 82 classrooms were initially 
assigned at random to SBI or control (“business as usual”) conditions. Teachers/classrooms 
served as clusters. 

The current study used a subset of data from the Jitendra, Harwell, et al. (in press) study 
that consisted of students at risk for MD-PS (see Participants section). The classrooms of these 
students were assigned at random to SBI or control conditions, and students had already 
completed their participation in the Jitendra, Harwell et al. study. Thus, the research design for 
the current study was a retrospective randomized cluster design with longitudinal data. We argue 
that the strengths of randomly assigning the original 82 classrooms to SBI or control conditions 
are present in the current study. Specifically, we assume that whether a classroom was randomly 
assigned to the SBI or control condition in Jitendra, Harwell, et al. was unrelated to whether 
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students within that classroom were subsequently categorized as students with MD-PS. 

Thus, classrooms in the SBI or control condition should be approximately equal on background 
variables at pretest. 

Participants 

In the 82 classrooms, a total of 1,999 students participated in Jitendra, Harwell, et al. (in 
press). As described above, the current study focuses on a subgroup of those students with MD- 
PS. There is a lack of consensus on the definition of mathematics difficulties, “especially as it 
applies to identifying risk factors related to problem solving” (Swanson, Moran, Lussier, & 
Fung, 2014, p. 113). Because the focus of this study was on problem solving deficit, we 
operationalized MD-PS as scores below the 35 th percentile on a general measure of mathematical 
problem solving (Process and Applications subtest of the Group Mathematics Assessment and 
Diagnostic Evaluation [GMADE]; Pearson Education, 2004). This criterion was selected to 
ensure broad representation of students who may be at low-to-high risk of developing 
mathematics difficulties (see Bottge et al., 2015; Fuchs et al., 2014; Mazzocco, 2007). Based on 
scores on the GMADE measure administered at pretreatment, 806 students from among the 
1,999 seventh graders who participated in the larger study were identified as having MD-PS. Of 
the 806 students with MD-PS, 399 were in SBI classrooms and 407 were in business as usual 
control classrooms. On the screening measure, the performance of SBI students was comparable 
to that of the control students. The mean GMADE score was 9.73 ( SD = 2.02) for SBI and 9.80 
(SD = 2.07) for the control group. 

Table 1 presents student and teacher demographic data. In general, students were largely 
White with more than one-half male and demographic patterns that were similar across the 
treatment and control groups. For example, the percentages of White, Black, Hispanic, and Asian 
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students in the treatment group were 77.6, 8.9, 7.0, and 6.4, respectively; for the control 
group these percentages were 77.1, 8.4, 7.9, and 6.6, respectively. Similar results emerged for 
teacher characteristics in the treatment and control groups. These findings support our 
assumption that students with MD-PS were equally distributed across the treatment and control 
classrooms. 

Screening Measure 

The Process and Applications subtest of the GMADE (Pearson, 2004), a standardized 
broad measure of problem solving, evaluates students’ ability to comprehend mathematical 
language and concepts and apply relevant operations to solve word problems across multiple 
content areas (e.g., algebra, geometry, number and operations). Reliability for this measure was 
0.68 for fall and 0.77 for spring standardization samples. Several studies support the criterion- 
related validity of the GMADE. For example, correlations between the GMADE and KeyMath 
Revised-Normative Update (Connolly, 2007) were above .80. 

Outcome Measure 

The proportional problem-solving (PPS) test (Jitendra, Harwell, et ah, in press), a 
researcher-developed measure is comprised of released items from NAEP, TIMSS and state 
mathematics assessments related to the topics of ratio/rate, proportion, and percent. The 
assessment consists of 23 multiple-choice (13 ratio and proportion, 10 percent) and four short- 
response items. The multiple-choice items were machine-scored dichotomously as 
correct/incorrect. The research team, blind to study conditions, scored the four short-response 
items on a 0-to-2 point scale using a rubric (e.g., using sample student responses taken from a 
previous study), which emphasized correct reasoning. Inter-rater reliability was estimated using 
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an intra-class correlation and averaged 0.85, 0.91, and 0.89 at pretest, posttest, and 
delayed posttest, respectively. 

To assess the reliability of the PPS items, we used the jMetrik software (Version 2.1.0; 
Meyer, 201 1) to fit the congeneric model assuming a single continuous latent factor underlies the 
dichotomous- and trichotomously-scored PPS items (McDonald, 1999). The coefficient omega 
(Dunn, Baguley, & Brunsden, 2014) values for the PPS pretest, posttest, and delayed posttest of 
0.54, 0.69, and 0.68, respectively, represent reliabilities estimated as the ratio of true score 
variance to observed score variance (Dunn et al., 2014; Revelle & Zinberg, 2009). 

Treatment Acceptability Rating Scale-Revised (TARF-R) 

Students in the treatment condition completed a modified version of the TARF-R (Refiners 
& Wacker, 1988) at the end of the study. Students were asked to rate four items each related to 
diagrams (e.g., helped to organize information and understand how to solve problems) and 
problem solving procedures (e.g., helpful in checking understanding of how to solve word 
problems) as well as one item on multiple solution strategies (e.g., enjoyed solving word 
problems using the different strategies - cross multiplication, unit rate, equivalent fractions) on a 
l-to-4 scale (4 = strongly agree - 1 = strongly disagree). Coefficient alpha was 0.83. 

Teacher Satisfaction Survey 

Treatment teachers completed a survey of their perceptions of the SBI intervention at the 
end of the study. This instrument included 22 items that focused on the (a) overall benefits of the 
SBI intervention (e.g., the SBI curriculum will produce a lasting improvement in most students’ 
problem solving skills), (b) ratio, proportion, and percent diagrams (e.g., diagrams are effective 
in highlighting the underlying mathematical structure of problems and mediating problem 
solution), and (c) problem solving procedures, including focus on multiple solution strategies. 
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The items were evaluated on the same 0-to-4 scale as the TARF-R. For this sample, 
coefficient alpha was 0.92. 

Procedure 

In mid-December, treatment teachers received professional development (see Professional 
Development section), and all teachers administered the GMADE and the PPS pretest following 
a standardized administration protocol. Teachers then provided instruction from early January to 
mid February on the topics of ratio, proportion, and percent for six weeks, five times per week, 
using either SBI or their district-adopted curriculum. In mid February to early March (within 
three weeks of the end of intervention), teachers re-administered the PPS (posttest) and again 
approximately nine weeks later (delayed posttest) to assess intervention effects. Student 
demographic information (e.g., sex, age, ethnicity, free or reduced lunch status) was also 
collected from the Minnesota Department of Education. 

Professional development 

Treatment teachers in Jitendra, Harwell, et al. (in press) participated in an intensive 2-day 
(16 hr) professional development training covering implementation of the SBI intervention. The 
following were covered during professional development: (a) a detailed description of key 
features of the SBI intervention to support student learning of ratio, proportion and percent, (b) 
implementation of SBI intervention components, including sorting problems by problem types, 
using schematic diagrams to represent information in the problem, generating “ballpark” 
estimates (quick and easy based on benchmark numbers and fractions), and selecting an 
appropriate solution method from among several strategies to solve problems, (c) procedures to 
facilitate student discussion, with an emphasis on developing their proportional reasoning skills 
using video segments of SBI teachers from previous studies, and (d) a discussion of 
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implementing SBI and assessments faithfully as well as not sharing project materials 
and/or strategies with any control group teachers in their building. 

Intervention Procedures 

Teachers in the Jitendra, Harwell, et al. (in press) study provided all students in the 
treatment and “business as usual” control classrooms instruction during their regularly scheduled 
seventh-grade mathematics classes. In both conditions instruction included two instructional 
units on Ratio/Proportion and Percent, which was delivered daily over the course of 6 weeks. 
Students in control classes received business-as-usual classroom instruction that addressed the 
same topics as in the units taught in the treatment classes. Thus, all students were provided the 
opportunity to learn the same content over the same period of time regardless of random 
assignment to treatment or control classes. However, the delivery of the content differed in that 
treatment classes used the SBI components described below, and the control classes received 
instruction that would typically occur in a seventh-grade mathematics class. 

Description and Implementation of SBI 

The instructional components of the SBI treatment are described in the original study 
(Jitendra, Harwell, et al., in press) and include: (a) activation of the mathematical structure of 
problems, (b) representation of information in the problem using diagrams, (c) development of 
procedural flexibility through selection and use of appropriate solution strategy based on the 
numbers in the problem, and (d) problem solving and metacognitive (e.g., monitoring) strategy 
instruction. The problem solving and metacognitive strategy instruction component allows 
students to engage in applying learned content (e.g., ratios/rates, percent) in problem solving 
activities (e.g., recognizing the problem type, identifying and representing critical information in 
the problem using an appropriate diagram, connecting the problem to what is already known, 
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estimating the answer, selecting a strategy to solve the problem, checking the 
reasonableness of the solution) and metacognitive activities (i.e., monitoring and reflecting on 
the problem-solving process). 

Activating the mathematical problem structure. Teachers engaged students through 
deep-level questions to identify the type of problem by reading, retelling, and examining 
information in the problem as well as thinking about how problems within and across types are 
similar or different. Students critically evaluated whether a problem belongs to a particular 
category of problems (i.e., ratio, proportion, or percent) based on the problem features (e.g., 
proportion problems describe a statement of equality between two ratios/rates that allows one to 
think about the ways that the two situations are the same). 

Representing the problem using diagrams. Teachers provided instruction on 
representing information in the problem using schematic representations that effectively linked 
the relationships between the relevant quantities in the problem. During problem representation, 
students were provided opportunities to critically reason why the same ratio schematic diagram 
can be used to represent information in both ratio and percent problems (a percent is a special 
type of ratio). Furthermore, instruction emphasized that even though ratio diagrams work well 
for some percent of change problems in representing the relation between the change amount and 
original amount, more complex percent of change problems (including simple interest) elicit the 
need for representations that depict both multiplicative and additive relationships (see Ratio and 
Percent diagrams in Figure 1). 

Using multiple solution strategies. Teachers encouraged students to deeply process 
information about when, how, and why to use a broad range of methods (e.g., equivalent 
fractions, unit rate, cross multiplication) for a given class of problems, thereby improving 
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procedural knowledge. Instruction supported using and contrasting multiple solution 
methods so that students become cognizant of specific methods that are more efficient than 
others and select the strategy that is most efficient based on the numbers in the problem. 

Teachers implemented the two replacement units (Ratio/Proportion and Percent) that 
consisted of the SBI instructional components embedded within their instruction. They were 
provided with a detailed teacher guide as a resource, along with teaching materials (e.g., visual 
diagrams and problem solving checklists) to support implementation of activities to develop 
critical concepts and skills. Students received a set of materials (i.e., workbook and homework 
book) that included problems and application activities. 

Instruction in Control (“business-as-usual”) Classes 

Information on textbooks used in the control classrooms was also gathered in Jitendra, 
Harwell, et al. (in press) from: (a) a written teacher questionnaire in which teachers listed the 
mathematics textbooks they used, (b) a review of ratio/proportion and percent lessons in the 
textbooks, and (c) an observation of one videotaped lesson of each teacher’s activity related to 
the target topics. Overall, the control classrooms used 10 different textbooks published from 
2001 to 2012 by one of three publishers: Houghton, Mifflin, Harcourt; Glencoe/McGraw Hill; 
Pearson Education. We examined the textbooks for the presence of core SBI instructional 
components (i.e., identifying the problem type, visual representations, modeling of problem 
solving and metacognitive strategies, multiple solution strategies) and found that the instructional 
components covered did not overlap with those in treatment classrooms in ways that would 


distort estimates of the effects of SBI. 
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Fidelity of Treatment 

Jitendra et al. (2014) developed a measure based on guidelines proposed by O’Donnell 
(2008) to measure fidelity of implementation (Dane & Schneider, 1998) and overall quality of 
instruction in treatment and control classrooms based on attributes of effective teaching. Fidelity 
information was generated by videotaping an entire lesson on proportion problem solving for 
each teacher in the treatment and control conditions during the 6 weeks of the study. A 7-item 
measure was developed to determine the extent to which SBI teachers implemented the key 
components of the treatment: (a) identified the problem type by focusing on the key problem 
features, (b) connected the new problem to previously solved problems, (c) represented critical 
information in the problem text using an appropriate diagram, (d) generated an estimate prior to 
solving the problem, (e) discussed multiple solution strategies, (f) solved the problem and 
presents the solution within the context of the problem, and (g) evaluated the solution. The same 
measure was used in the control condition to evaluate program differentiation (Dane & 
Schneider, 1998). 

Coders reviewed the videotapes and assigned a rating for each component. In addition, 
four global quality ratings were assigned based on the entire observation with regard to the 
teacher’s ability to: (1) clarify the lesson purpose, (2) provide lesson closure, (3) manage 
instructional time (i.e., how well the teacher managed student behavior), and (4) minimize 
mathematical errors. Procedural fidelity and overall quality of instruction items were coded on a 
0-to-3 scale (3 = high level of implementation - 0 = did not implement). 

Coder training and reliability. One of the authors, in consultation with the developer of 
the SBI program, developed the coding scheme for the fidelity measure. The measure was 
finalized after multiple rounds of independent video coding by six coders, discussion, and re- 
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operationalization of the codes. During coder training, videotapes were coded until 
agreement of codes was 90% or higher. Two coders independently assessed fidelity for each 
classroom video. Disagreements in coding were resolved through discussion and review of the 
videotapes. We estimated inter-rater reliability by computing intra-class correlations for the 
coder ratings, which averaged 0.98 across the seven procedural items (range 0.97 to 0.99) and 
0.99 across the four quality instruction items (range 0.96 to 1.00). 

Analysis of fidelity. We conducted t - tests to test group differences on both the fidelity 
and quality of instruction data and used the Dunn-Bonferroni correction to control for 
compounding of Type 1 error. Results indicated statistically significant and substantial 
differences between the treatment and control groups on the total fidelity of implementation 
score, t( 78) = 8.82 ,p <.001, and all individual items (p <.005) except for item 6 (i.e., solves the 
problem and presents the solution within the context of the problem), with treatment teachers ( M 
= 14.33; SD = 3.86) implementing SBI elements more than control teachers (M = 7.43; SD = 
3.00). For the quality of instruction there were no statistically significant differences between the 
groups (SBI: M = 9.50, SD = 1.28; Control: M= 9.28, SD = 1.71). These data provide evidence 
of program differentiation (Dane & Schneider, 1998) in that there were clear differences in SBI 
instructional elements across the two groups, whereas the general quality of instruction was 
similar in both conditions. 

Data analyses 

We used two-level (students within classrooms) multilevel models to capture the 
hierarchical nature of the cross sectional data (see Raudenbush & Bryk, 2002). The outcome 
variables included in the analyses were the PPS posttest (total score, ratio and proportion 
subscore, percent subscore) and PPS delayed posttest (total score, ratio and proportion subscore, 
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percent subscore), which were analyzed separately. We examined students’ performance 
on the ratio and proportion and the percent subscales separately on our PPS measure to address 
the two subdomains addressed by the intervention. A two-level model was fitted for each 
outcome variable using the HLM 6 software (Raudenbush, Bryk, & Congdon, 2004). In addition, 
we performed an ancillary analysis of the PPS longitudinal data to explore student change over 
time and whether change was related to the treatment. 

We controlled for compounding Type I error rates using the Dunn-Bonferroni correction 
(Miller, 1966) procedure in which an overall Type I error rate (a = .20) was divided among all 
statistical tests for an outcome with no requirement that the error rate be divided equally. We 
assigned .05 to the test of the treatment because this was the most important effect in the model 
and divided the remaining .15 equally among tests of the remaining fixed effects, producing 

.15 

a = — = .0115. Because of the importance of identifying variation to be modeled, tests of 
variance component used a = .05 . 

There was a modest amount of missing data, generally ranging from 4 % to 12% across 
variables, with approximately equal percentages of missing data for the treatment and control 
groups. Analyses of cases with complete data produced the same pattern of findings as analyses 
based on available data, and the latter are reported. 

Power Analysis 

An a priori power/sample size analysis using the Optimal Design software (Spybrook et al., 
2011) that focused on testing the SB I vs. control effect for cross-sectional data indicated that 82 
clusters and 800 students would allow us to detect a standardized effect of .40 (a small-medium 
effect following Cohen, 1988) with a power exceeding .90 for an intra-class correlation of .19 
(taken from Hedges & Hedberg, 2007). The effect size formula used in Optimal Design is 
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y 

5 = 01 , , where y 01 is the slope capturing the impact of the treatment, x 00 is the 

[Too+cr] - 

intercept variance, a 2 is the within-cluster (classroom) error variance, and 8 is the standardized 
effect size (i.e., .40) (Spybrook et al., 2011). These calculations were assumed to apply to each of 
the outcome variables (Proportional Problem Solving, Ratio/Proportion subscale, Percent 
subscale). 

Results 

Descriptive Results 

Descriptive results for the PPS variables by treatment are reported in Table 2. We 
conducted descriptive analyses that included exploring pre-existing differences between the SB I 
and control group students and examining the correlations between measures. As expected, the 
SBI and control groups did not differ significantly at pretest (t = 0.15, p > .05) on the total PPS 
scores, the Ratio/Proportion ( t = 0.1 6, p> .05), or the Percent subscale scores (t = \.l\,p> .05) 
Results of the bivariate correlation analyses showed that the correlations between the 
total PPS pretest-posttest, pretest-delayed posttest, and posttest-delayed posttest were 0.52, 
0.49, and 0.65, respectively. For the PPS subscales, the correlations between the PPS 
Ratio/Proportion pretest-posttest, pretest-delayed posttest, and posttest-delayed posttest were 
0.51, 0.49, and 0.60, respectively; the correlations between the PPS Percent pretest-posttest, 
pretest-delayed posttest, and posttest-delayed posttest were 0.24, 0.22, and 0.45, respectively. 
Treatment Effects on Proportional Problem Solving 

Tables 3 and 4 show the HLM results for the PPS total score posttest and delayed 
posttest. Figure 2 shows percentage correct improvement from pre- to post-treatment on the MPS 
posttest and delayed posttest. 
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PPS total score posttest. The ICC for the unconditional model was .2 1 and was 
statistically significant (p < .001). Thus 21% of the variation in the PPS total score posttest was 
between-classrooms, a value consistent with results for mathematics scores reported in Hedges 
and Hedberg (2007). The two-level model that was fitted had five student predictors (gender, 
Black, Asian, Hispanic, PPS pretest), which were grand-mean-centered, and seven teacher 
predictors (treatment, number of undergraduate/graduate mathematics courses, number of 
undergraduate/graduate pedagogy courses, %eligible for free/reduced price lunch in quintiles, 
%limited English proficient (LEP) in quintiles, %special education in quintiles), which were not 
centered. 

The percentage of free/reduced price lunch, LEP, and students qualified for special 
education services were aggregated to the classroom level (e.g., %LEP students in a classroom) 
because for many classrooms there was little or no variation on these characteristics (e.g., one- 
half of the classrooms had no LEP students), compromising estimation of model parameters 
within each classroom. Moreover, the distributions of these percentages were ragged and 
discontinuous and were rescaled to quintiles and the rescaled versions used as classroom-level 
predictors. Only intercepts were modeled at level 2 because slope variances were statistically 
equal to zero. The HLM results for the PPS posttest are reported in Table 3. 

Table 3 shows that with other predictors held constant, treatment was a significant 
predictor of PPS total posttest scores (y 01 = 1.17), which translates to SBI students scoring on 

average 0.32 SDs higher than those in the control group, and a 22% reduction in the conditional 
intercept variance attributable to treatment. That is, treatment accounted for 22% of intercept 
variance beyond that attributable to other predictors in the model (Raudenbush & Bryk, 2002). 
Another significant result in Table 3 was for the classroom LEP variable (expressed in quintiles; 
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7 = -0.48, -0.1 1 SD), which shows that moving from one LEP quintile to the next was 

associated with an expected decline of 0.48 points in classroom PPS total score posttest 
intercepts (i.e., classrooms with higher concentrations of LEP students were associated with 
lower PPS total posttest scores). PPS pretest was also a significant predictor (y 50 = 0.53, 0.12 

SD), meaning that increases in pretest scores were associated with higher posttest scores. The 
remaining effects in Table 3 were not significant. 

Analyses of the PPS ratio/proportion and percent subscales for the fully unconditional 
model produced similar variation between classrooms (19%, 13%), similar treatment effects 
(0.62, 0.23 SD; 0.63, 0.32 SD), and similar variance attributable to treatment (16%, 29%). LEP 
was a significant predictor of the ratio/proportion outcome (-0.39, -0.12) but not the percent 
outcome. 

PPS posttest-delayed total score. The ICC for the unconditional model was .19 and was 
statistically significant (p < .001). Thus 19% of the variation in PPS posttest-delayed total score 
was between classrooms. The same predictors fitted to the PPS total posttest score data were 
used and the results are reported in Table 4. Once again, none of the student model predictors 
had slopes that varied significantly across classrooms and only the classroom intercept model 
had predictors. 

The treatment effect was significant (7 = 0.93) and translates to SBI students scoring on 

average 0.25 SDs higher than those in the control group, or treatment accounted for 16% of 
intercept variance beyond that attributable to other predictors in the model. The PPS pretest was 
again a significant predictor ( y 50 = 0.5 1) . 

Treatment was also a significant predictor of the ratio/proportion subscale on the PPS 
delayed posttest (y 01 = 0.81, 0.30 SD) , with 14% of the variance due to treatment (ICC = 18% 
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for fully unconditional model). LEP was again a significant predictor (-0.35, -0.11 SD), 
with increases in the concentration of LEP students in a classroom associated with a decline in 
average performance on the delayed posttest for the ratio/proportion subtest. However, treatment 
was not a significant predictor of percent scores on the PPS delayed posttest. 

Longitudinal analyses of PPS. We explored the ability of treatment to moderate student 
growth over time by fitting a three-level model in which level 1 (repeated measures) was within- 
students and consisted of the PPS pretest, posttest, and delayed-posttest total scores, level 2 was 
between-students, and level 3 was between classrooms. The average growth rate (linear slope) 
was 0.77 (p < .001) indicating that on average student’s PPS scores increased over time. Growth 
rates did not vary significantly between students and, thus, treatment did not moderate student 
growth. The only significant effect in this analysis indicated that Hispanic students on average 
scored about 1 .25 points lower on the PPS pretest than White students. 

TARF-R. The mean score for SBI students with MD-PS was 3.16 ( SD = 0.66) on 
diagrams and 2.59 ( SD = 0.58) on the problem-solving procedure. On the multiple solution 
strategies item, the mean score was 2.95 ( SD = 0.98) 

Teacher satisfaction survey. The mean scores were 3.34 (SD = 0.35) for the total score, 
3.41 (SD = 0.42) for the overall benefits of the SBI intervention, 3.54 (SD = 0.42) for diagrams, 
and 3.12 (SD = 0.47) for problem solving procedures. 

Discussion 

The goal of this retrospective randomized controlled design study was to determine 
whether the positive effects of the SBI intervention in the previous efficacy study (Jitendra, 
Harwell, et ah, in press) would uphold for students with MD-PS. Overall, our SBI intervention, 
which targeted understanding of ratios and proportional relationships, significantly improved 
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proportional problem solving outcomes in students at risk for MD-PS at both immediate 
and delayed posttests. Students in treatment classes performed approximately one third of a 
standard deviation higher than students receiving typical mathematics instruction in the same 
content on the PPS total score at immediate posttest. This translates to approximately 63% of 
treatment classrooms scoring above the mean of control classrooms (Lipsey et ah, 2012). It was 
also encouraging that treatment students maintained these gains nine weeks following the 
intervention. Students in treatment classes performed one quarter of a standard deviation higher 
than students receiving typical mathematics instruction on the PPS total score at delayed posttest, 
meaning that approximately 60% of treatment classrooms scored above the mean of control 
classrooms (Lipsey et al., 2012). As predicted, our findings revealed that the SBI intervention’s 
focus on promoting deep conceptual and procedural knowledge was effective in enhancing the 
proportional problem solving performance of students at risk for MD-PS. These findings expand 
previous results showing that proportional reasoning can be supported effectively by the SBI 
intervention. Although the effects in this study are smaller than those in Jitendra, Harwell et al. 
(in press; g = 0.46 and 0.32 for posttest and delayed posttest) and Jitendra, Dupuis, et al (in 
press; g = 0.40 and 0.42 for posttest and delayed posttest), the effect sizes of .25 and above are 
considered substantively important (see What Works Clearinghouse, 2014). 

We were also interested in knowing whether the findings would provide support for the 
SBI treatment effects in improving students’ performance on both ratio and proportion and 
percent PPS subscales. Although the SBI group outperformed the control group on the ratio and 
proportion subscale at both posttest and delayed posttest (.23 SDs and .30 SDs higher than the 
control group), we found treatment effects only at immediate posttest (.32 SDs higher than the 
control group) for the percent subscale. These findings partially support our hypothesis that the 
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SBI intervention’s focus on effective instructional practices (e.g., activating the 
mathematical structure of problems, representing the problem situation using an appropriate 
diagram, monitoring and reflecting on the problem solving processes) would have similar 
positive effects on improving students’ scores on the PPS subscales. Our results build on and 
contrast those obtained by Jitendra, Dupuis, et al (in press), who found positive treatment effects 
for students at risk for both MD only and MDRD on the ratio and proportion subscale (g = .29) 
at delayed posttest only and for the percent subscale at both posttest (g = 0.42) and delayed 
posttest (g = 0.39). It should be noted, however, that the current study is not a direct comparison 
to Jitendra, Dupuis, et al (in press), which used scores on end-of-the-year state mathematics and 
reading achievement to identify students with MD only and MDRD. In contrast, we used cutoff 
scores on a diagnostic measure of mathematical problem solving to specifically identify risk 
factors related to problem solving. Students' difficulties with percent word problems in our study 
may be due to several reasons. In particular, it is well known that within the larger category of 
proportion reasoning problems, one particularly troublesome topic for students is percent 
(Lembke & Reys, 1994; Parker & Leinhardt, 1995). The many different ways that 
mathematically similar percent problems can be expressed highlights the importance of looking 
beyond surface features of word problems to identify and analyze underlying mathematical 
relations (Marshall, 1995). As such, additional focus and careful, targeted instruction of percent 
problems may be needed to demonstrate stability of acquisition of percent problems for students 
at risk for MD-PS receiving the treatment. 

We also examined whether treatment moderated student growth over time. Although 
average student’s PPS scores increased over time, growth rates did not vary significantly 
between students and thus were unrelated to being in the treatment or control condition. The 
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findings did not support our hypothesis that SBI would have a pronounced positive effect 
on a student’s growth over time. Given that students in the treatment condition did not 
significantly outperform students in the control condition on percent problem solving at delayed 
posttest, it could possibly explain the lack of difference in growth rates over time. More 
intensive attention to percent problem solving and the supports students require to sustain the 
gains over time may be needed. 

We also documented fidelity of implementation in both treatment and control classes. The 
data suggest that the SBI treatment was implemented within a middle range, and the evidence for 
the presence of the SBI elements in the comparison classes was in the low range confirming that 
the SBI treatment caused improvement in students’ proportional problem solving performance. 
Limitations and Implications for Future Research and Practice 

The findings of this study suggest the efficacy of the SBI intervention to improve 
proportional reasoning skills for middle school students. The consistent findings for improved 
proportional reasoning skills from this study and two other studies examining SBI 
implementation in general education and special education middle school classrooms for 
students at risk for MD (Jitendra, Dupuis, et ah, in press; Xin et ah, 2005) provide an evidence- 
base for SBI as a useful practice. 

However, several limitations of the study require caution in interpreting the findings. One 
limitation that should be considered is the issue of low reliability estimates for the outcome 
measure, especially the pretest. While the reliability estimates for the larger sample in Jitendra, 
Harwell, et al. (in press) were adequate, the low reliability for the current study sample may be 
due to the homogeneity of the sample of students at risk for MD. The reliability coefficients for 
our sample, although sufficient for making group comparisons, may underestimate the treatment 
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effects (see Thorndike, 1977). That is, low reliability may not be a concern especially in 
light of the significant treatment effects we found in this study. 

Another potential limitation is that only one lesson per teacher was videotaped to assess 
fidelity. However, it is worth noting that given the relatively brief period of the intervention (six 
weeks), one video-recorded observation may be sufficient to provide a representative sample of 
participant functioning (Breitenstein et ah, 2010). Unlike direct observation or audiotaping of 
lessons, video-recorded data provided several important advantages (e.g., ability to capture 
complex interactions, allow multiple viewings) and helped us maintain the quality of the coding 
that was done. 

Our study did not address exactly what features of the SBI intervention were most 
effective in helping students develop proportional reasoning skills. Although effective 
instructional components and appropriate scaffolds (e.g., schematic diagrams, problem solving 
checklists) might account for SBI’s positive effect for students with MD-PS in this study, it is 
not known whether certain components are more relevant for some students than others. 
Effectively scaffolding the representation and solution processes by providing diagrams that are 
appropriate for the task and teaching students to represent the problem situation as well as using 
problem solving checklists to support them as they solved problems may have reduced the 
cognitive load placed on students with MD-PS (Berends & van Lieshout, 2009; Lee, Ng, & Ng, 
2009). Evidence of the benefits of diagrams and checklists was demonstrated through SBI 
students’ ratings. Although students liked using a variety of strategies to solve the problems, it is 
not known whether teaching multiple solution strategies placed additional demands on students 
with MD-PS. Future research could test individual components for effectiveness so that 
interventions would include only the most effective components. 
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This study occurred over a relatively brief period (6 weeks of daily instruction, 
five days a week) and did not meet the recommendation in the best evidence syntheses of a 12- 
week criterion to ensure external validity (Slavin, 2008). Even though the duration of our study 
is consistent with the time commonly allocated to the topics of ratio, proportion, and percent in 
middle schools, the differential results for ratio and proportion and percent problem solving on 
the delayed posttest indicates a need for longer duration of the intervention in sustaining the SBI 
effects particularly for percent problem solving. As such, future research examining impacts 
from longer implementations for students with MD-PS is warranted. 

The findings of the study have potentially important implications for practice. First, this 
study provides evidence of the promise of the SBI practices, including recognizing the problem 
structure, using schematic diagrams to illustrate the mathematical relations among key elements 
in the problem, monitoring and reflecting on the problem solving process, and using a variety of 
strategies, for improving student learning. The findings suggest that when teachers incorporate 
these practices in their instruction, it can result in important and sustaining benefits for their 
students, including students with MD-PS. Second, it is important to try to understand why SBI 
did not moderate student growth over time. Results suggest that the percent content was complex 
and may have implications for the design of interventions to meet the needs of students with 
MD-PS. This could include intensive instruction (i.e., small group instruction, sustained and 
elaborated instruction) for students with MD-PS to master this content. 

In conclusion, our SBI intervention approach is effective for enhancing the ability of 
seventh-grade students at risk for MD-PS to master proportional problem solving. Given the 
context of the “Common Core” framework of high standards, this study provides evidence that 
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careful, targeted instruction of complex content and ambitious mathematics practices 

may need to occur over a sustained period of time for students with MD-PS to benefit from the 

treatment. 
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Table 1. 

Participant Demographic Information by Treatment 





Treatment 







SBI 

Control 

Total 



n 

% 

n 

% 

n 

% 



Student Information 





Age 

M(SD) 

12.63 

(0.40) 

12.56 

(0.35) 

12.60 

(0.38) 

Sex 

Female 

179 

44.9 

198 

48.6 

377 

46.8 


Male 

205 

51.4 

186 

45.7 

391 

48.5 

Missing (age and sex) 


15 

3.8 

23 

5.7 

38 

4.7 

Race 

Asian 

22 

5.5 

30 

7.4 

52 

6.5 


Black 

49 

12.3 

51 

12.5 

100 

12.4 


Hispanic 

31 

7.8 

37 

9.1 

68 

8.4 


White 

280 

70.2 

266 

65.4 

546 

67.7 

FRL 

Yes 

181 

45.4 

190 

46.7 

371 

46.0 


No 

201 

50.4 

194 

47.7 

395 

49.0 

LEP 

Yes 

30 

7.5 

37 

9.1 

67 

8.3 


No 

352 

88.2 

347 

85.3 

699 

86.7 

SpEd 

Yes 

58 

14.5 

48 

11.8 

106 

13.2 


No 

324 

81.2 

336 

82.6 

660 

81.9 

Missing (race, FRL, LEP, 

SpEd) 

17 

4.3 

23 

5.7 

40 

5.0 



Teacher Information 





Sex 

Female 

26 

65.0 

29 

69.0 

55 

67.1 


Male 

14 

35.0 

13 

31.0 

27 

32.9 

Math courses taken 

M(SD) 

8.60 

(3.77) 

8.70 

(4.20) 

8.65 

(3.97) 

Education courses taken 

M(SD) 

4.24 

(4.81) 

2.87 

(2.65) 

3.54 

(3.89) 

Years experience in math 

M(SD) 

11.95 

(6.38) 

12.42 

(7.02) 

11.93 

(6.35) 

PD hours in math 

M(SD) 

24.88 

(30.94) 

23.65 

(17.61) 

24.25 

(24.86) 


Note. SBI = schema-based instruction; FRL = eligible for free or reduced price lunch; LEP = 
limited English proficiency; SpEd = students qualified for special education services; PD = 
professional development. 
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Table 2. 

Descriptive Statistics for PPS Measure by Treatment 





Treatment 




Total 



SBI 



Control 



M 

SD 

n 

M 

SD 

n 

M 

SD 

N 

Total PPS pretest 

11.47 

3.70 

398 

11.43 

3.59 

404 

11.45 

3.64 

802 

Missing 



1 



3 



4 

Total PPS posttest 

13.87 

4.73 

381 

12.69 

4.11 

374 

13.29 

4.47 

755 

Missing 



18 



33 



51 

Total PPS delayed 

13.55 

4.46 

372 

12.76 

4.37 

357 

13.16 

4.43 

729 

Missing 



27 



50 



77 

Ratio/Proportion pretest 

7.92 

2.93 

398 

8.07 

2.85 

404 

8.00 

2.89 

802 

Ratio/Proportion posttest 

9.46 

3.26 

381 

8.92 

3.21 

374 

9.19 

3.25 

755 

Ratio/Proportion delayed 

9.41 

3.21 

372 

8.89 

3.29 

357 

9.16 

3.26 

729 

Percent pretest 

3.55 

1.59 

398 

3.36 

1.63 

404 

3.46 

1.61 

802 

Percent posttest 

4.41 

2.25 

381 

3.77 

1.83 

374 

4.09 

2.08 

755 

Percent delayed 

4.14 

2.02 

372 

3.87 

1.85 

357 

4.01 

1.95 

729 


Note. SBI = schema-based instruction; M = mean; SD = standard deviation; PPS = proportional problem solving. All test statistics are 
based on the total number of items correct - the maximum possible points for the total score, ratio and proportion subscore, and 


percent subscore is 31, 17, and 14, respectively. 
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Table 3. 

HLM Analyses of PPS Posttest 




Total 



Ratio/Proportion 



Percent 


Fixed Effect 

B 

SE 

P 

B 

SE 

P 

B 

SE 

P 

Between-Student Model (n = 725) 









Sex 

0.25 

0.271 

.360 

-0.03 

0.198 

.881 

0.30 

0.147 

.041 

Asian 

0.28 

0.565 

.619 

0.11 

0.412 

.787 

0.15 

0.306 

.632 

Black 

-0.55 

0.447 

.218 

-0.43 

0.325 

.186 

-0.12 

0.242 

.607 

Hispanic 

0.14 

0.506 

.111 

-0.15 

0.368 

.676 

0.17 

0.273 

.526 

Pretest 

0.53 

0.040 

<.001 

0.49 

0.036 

<.001 

0.24 

0.047 

<.001 

Between-Classroom Model ( n = 82) 









Intercept 

14.16 

0.903 

<.001 

9.50 

0.634 

<.001 

4.60 

0.445 

<.001 

Treatment 

1.17 

0.391 

.004 

0.62 

0.274 

.026 

0.63 

0.193 

.002 

Sex 

-0.11 

0.422 

.800 

0.28 

0.296 

.352 

-0.31 

0.208 

.140 

Math courses 

0.03 

0.050 

.590 

0.02 

0.035 

.486 

0.02 

0.025 

.545 

Education courses 

-0.05 

0.052 

.360 

-0.02 

0.036 

.557 

-0.02 

0.026 

.476 

Years experience 

-0.01 

0.033 

.663 

-0.00 

0.023 

.975 

-0.02 

0.016 

.360 

PD hours 

-0.00 

0.007 

.636 

-0.00 

0.005 

.618 

-0.00 

0.004 

.675 

FRL 

-0.17 

0.176 

.339 

-0.05 

0.124 

.667 

-0.11 

0.087 

.196 

LEP 

-0.48 

0.161 

.004 

-0.39 

0.113 

.001 

-0.13 

0.079 

.096 

SPED 

-0.01 

0.147 

.957 

-0.06 

0.103 

.565 

0.00 

0.073 

.951 

Random Effect 


VC 


SD 

2 

X 


df 

P 


Total 

Classroom 

1.20 


1.09 

151.29 


72 

<.001 



Student 

12.36 


3.52 






Ratio/Proportion 

Classroom 

0.53 


0.73 

139.00 


72 

<.001 



Student 

6.59 


2.57 






Percent 

Classroom 

0.21 


0.46 

128.90 


72 

<.001 



Student 

3.70 


1.92 







Note. Sex (1 = female, 0 = male), Asian (1 = yes, 0 = no), Black (1 = yes, 0 = no), Hispanic (1 = yes, 0 = no), PPS pretest, and PPS posttest are 
student level variables; Treatment (1 = SBI, 0 = Control), Sex (1 = female, 0 = male), Math courses (number of undergraduate/graduate 
mathematics courses), Education courses (number of undergraduate/graduate pedagogy courses), Years experience (years teaching experience in 
mathematics), PD hours (number of professional development hours in mathematics in the last year), FRL (%free/reduced price lunch in 
quintiles), LEP (%LEP in quintiles), and SPED (%Special Education in quintiles) are teacher-level variables. 
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Table 4. 

HLM Analyses of PPS Delayed Posttest 




Total 



Ratio/Proportion 



Percent 


Fixed Effect 

B 

SE 

P 

B 

SE 

P 

B 

SE 

P 

Between-Student Model ( n = 702) 









Sex 

-0.13 

0.282 

.638 

-0.28 

0.205 

.173 

0.18 

0.142 

.195 

Asian 

0.81 

0.599 

.179 

0.66 

0.436 

.132 

0.11 

0.300 

.702 

Black 

-0.05 

0.477 

.913 

0.11 

0.347 

.752 

-0.17 

0.239 

.481 

Hispanic 

0.10 

0.529 

.854 

-0.02 

0.385 

.966 

-0.01 

0.264 

.974 

Pretest 

0.51 

0.041 

<.001 

0.48 

0.037 

<.001 

0.21 

0.046 

<.001 

Between-Classroom Model ( n = 80) 









Intercept 

14.00 

0.962 

<.001 

9.97 

0.709 

<.001 

4.04 

0.432 

<.001 

Treatment 

0.93 

0.404 

.025 

0.81 

0.298 

.008 

0.20 

0.182 

.286 

Sex 

0.24 

0.451 

.599 

0.07 

0.333 

.825 

0.19 

0.202 

.360 

Math courses 

0.02 

0.053 

.751 

-0.00 

0.039 

.988 

0.02 

0.024 

.300 

Education courses 

-0.00 

0.053 

.993 

-0.02 

0.039 

.620 

0.03 

0.024 

.273 

Years experience 

-0.01 

0.034 

.681 

0.00 

0.025 

.893 

-0.02 

0.015 

.252 

PD hours 

-0.01 

0.008 

.390 

-0.01 

0.006 

.137 

0.00 

0.003 

.726 

FRL 

-0.21 

0.182 

.261 

-0.07 

0.134 

.617 

-0.14 

0.082 

.093 

LEP 

-0.39 

0.166 

.023 

-0.35 

0.122 

.005 

-0.06 

0.074 

.443 

SPED 

-0.08 

0.153 

.589 

-0.15 

0.113 

.198 

0.01 

0.069 

.866 

Random Effect 


VC 


SD 

2 

X 


df 

P 


Total 

Classroom 

1.26 


1.12 

145.93 


70 

<.001 



Student 

12.91 


3.59 






Ratio/Proportion 

Classroom 

0.71 


0.84 

153.21 


70 

<.001 



Student 

6.81 


2.61 






Percent 

Classroom 

0.18 


0.42 

117.71 


70 

<.001 



Student 

3.31 


1.82 







Note. Sex (1 = female, 0 = male), Asian (1 = yes, 0 = no), Black (1 = yes, 0 = no), Hispanic (1 = yes, 0 = no), PPS pretest, and PPS posttest are 
student level variables; Treatment (1 = SBI, 0 = Control), Sex (1 = female, 0 = male), Math courses (number of undergraduate/graduate 
mathematics courses), Education courses (number of undergraduate/graduate pedagogy courses), Years experience (years teaching experience in 
mathematics), PD hours (number of professional development hours in mathematics in the last year), FRL (%free/reduced price lunch in 
quintiles), LEP (%LEP in quintiles), and SPED (%Special Education in quintiles) are teacher-level variables. 
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Figure Captions 


Figure 1. Ratio and Percent Diagrams. 

Figure 2. Proportional problem solving posttest and delayed posttest scores by condition. Note. 
SB I = schema-based instruction. 
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Problem Type 


Schematic Diagram 


Ratio 

Two out of three students in Mr. Peter’s class 
have pet dogs. If 18 students have dogs, how 
many students are in Mr. Peter’s class? 


Compared 


c \ 

18 

Students with pet 
dogs 


x 

Total number of 
students in class 


© Ratio 
value 


Base 


Percent 

Janie got 18 words correct out of 20 words on 
her spelling test. Each word was worth one 
point. What was her grade, written as a 
percent, on the spelling test? 


Compared 


Part 


Whole 



Ratio value 


Base 


Simple Percen t of Change 

A tree that was 10 feet tall grew by 5 feet. 
What percent has it grown? 


Change 


Compared 



Original 



Ratio value 


Base 


Complex Percent of Change 

The library ordered 200 books last year. This 
year, they ordered 180 books. What is the 
percent of change from last year to this year in 
the number of books ordered? 



Base 


200 books 

1 & 
l z 

/^ 20 \ 

Zbooks 

Z” 

r 

180 

books 

Original 


Change 


New 


Simple Interest 

Anna deposits $700 in a savings account at 
the beginning of the year. The simple annual 
interest rate for the savings account is 5%. 
What will be the balance in Anna’s account at 
the end of the year? 


Change 

(Simple 

interest) 


Original 

(Principal) 


Compared 





Original Change New 

(Principal) (Simple Interest) (Balance) 
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■ SBI 

° Control 


